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Outline 

• sRGB - DX9, DXIO, XBox 360 


• Tone Mapping 

• Motion Blur 
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sRGB Outline 

• sRGB & gamma review 


• Alpha Blending: DX9 vs. DXIO & XBox 360 


• sRGB curve: PC vs. XBox 360 
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sRGB Review 

Terminology: 


• Color textures are stored in "gamma space” 


• Want our pixel shader to run in "linear space” 


PC Gamma 



sRGB Read 



PC Gamma to Linear 



PC Gamma 
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sRGB & Gamma Conversions 


sRGB Read: 


PC Gamma 


Linear 



sRGB Write: 
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Hardware 

Gamma Curve: 
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Alpha Blending w/ sRGB Writes 
DX9 vs DXIO & XBox 360 
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Alpha Blending w/ sRGB Writes 
DX9 vs DXIO & XBox 360 



Notice the thicker smoke, glows on the gravity gun, and health GUI 
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Alpha Blending on DXIO HW and XBox 360 



DX9 with sRGB writes 

Linear PC Gamma 



DXIO Si XBox 360 with sRGB writes 



Linear 



PC Gamma Linear 



Linear Space Linear 



PC Gamma 
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I mportant Details 

• DXIO hardware running on DX9 will blend 
with DXlO's behavior! 


• This affects DX9 games that have already 
shipped! 
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Solutions 

1 . Detect DXIO behavior and simulate the 
sRGB write in shader code forcing gamma 
blending 


2 . Let your artists tweak your materials for the 
obvious cases 


We chose #2, and the artists only modified 40 
out of thousands of materials in HL2, Epl, 
Ep2, TF2, and Portal 
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Example From Half-Life 2 
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sRGB Curve: PC vs. XBox 360 

• PC hardware uses the actual sRGB curve 


• XBox 360 uses a piecewise linear approximation to 
the sRGB curve 


PC Gamma 



360 Gamma 
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NOTE: The srrooth curve representing the PC sRGB curve in these slides doesn't 
accurately represent the actual sRGB curve that is linear in the low end. 
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Different Gamma Spaces 

• We stopped using the term "Gamma Space" 
and instead... 


• "PC Gamma Space" - Official sRGB curve 

. "360 Gamma Space" - Piecewise linear sRGB 
approximation found on the XBox 360 

• "Linear Space" 
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PC Gamma on PC 




(Using PC Gamma textures on the PC) 
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^amiepevelopers: 



Uncorrected 360 Results 



(Using PC Gamma textures on the XBox 360) 
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What J ust Happened? 

On PC, linear in pixel shader: 



On 360, nonlinear in pixel shader: 


PC Gamma 
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Bad Gamma! 
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Solutions 

1 . XBox 360-only developers: Use a 
Photoshop color space plug-in 


2 . Simulate sRGB reads and writes in shader 
code (Performance!) 


3. Convert color textures at tool time and use 
the hardware gamma curve 


Orange Box uses #3. Let's take a closer look. . . 
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The Orange Box Solution for XBox 360 

• Want to use the hardware "sRGB" reads & writes 

• We can modify the input textures so that the 360's 
piecewise linear read gets us to linear space! 


Preprocess: 


Run-time: 


PC Gamma 


Linear 



360 Gamma 
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I Texture 


360 Gamma 
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Render Target 
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• But, 360 gamma space looks wrong on a TV or 
monitor! Need to get back to PC gamma space... 
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Using the Hardware Gamma Curve 





We also use the hardware gamma curve to optionally 
correct for “blacker-than-black" colors displayed on 
a television and the deeper gamma of televisions. 
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XBox 360 Lossy sRGB Read 


• I n linear space, the lossy range is 0.0-0.14, so generally OK. 
This caused very few issues for us, but... 

• Don't use the hardware sRGB reads for post processing or 
feedback effects! Simulate the piecewise linear sRGB read in 
shader code... it's only —11 asm instructions. 
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NO LOSS 
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sRGB Summary 



feamepevelopers: 

feQ.at€i,L^ nce 


Alpha blending differences exist 

• We let the artists tweak around this 


• XBox 360 has a different gamma space 

• Convert color textures PC -> 360 Gamma Space 

• Set hardware gamma ramp for end correction 

• XBox 360 HW sRGB read is lossy at the dark 
end (in linear space, 0.0-0.14) 
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Tone Mapping Outline 

• Brief overview of Valve's HDR rendering 


• Building the histogram 


• Computing the tonemap scalar 
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Overview of Valve's HDR Rendering 


• Lighting data and environment maps are 
stored in HDR linear space 

• Every pixel shader scales the linear HDR 
value by our tonemap scalar (Back buffer is 
RGBA8888!) 

• I ncrementally build histogram each frame 

• Tonemap scalar is generated from the 
current histogram each frame 


• More details on the first 2 points: 

http: //WWW, valvesoftware. com/ publications, html 


VALVE 




WWW.GDCONF.COM 




Building the Histogram 
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• Amortize the cost of building the histogram over 16 
frames 

• Update one bucket per frame 

• Sample post-tonemapped frame 

• Use an asynchronous occlusion query to count pixels 
in range 
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Sampling Each Histogram Bucket 






Evaluating the Histogram 


• Our first implementation was based on median 
luminance (Shipped in HL2: Episode One, Day of 
Defeat, Lost Coast) 



(NOTE: All histograms are in linear space!) 


• But, we ran into too many cases in The Orange Box 
that caused tonemapping to behave strangely. 
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Dark Skies! 





This environment was tonemapping too dark 
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Dark Skies! 
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This is what we wanted 
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Bright Pixels Matter 


Experiment: Dont use median luminance (50%) 

Use a different histogram threshold: Keep 5% of bright pixels 
in top bins 


@95% 


95% of the pixels 




5% of the pixels 



95% of the pixels 


@95% 

5% of the pixels 
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Results From Using 95% Threshold 
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This worked great! Except for... 
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Zombies on Fire! 



Bright pixels from the fire caused 


tone mapping to over darken the screen! 
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Need a Secondary Rule 


• Primary rule: Brightness threshold 

• Secondary rule: Use median luminance as a darkness barrier 



(NOTE: All histograms are in linear space!) 
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Zombies Fixed With Both Rules 



This worked! But we still had one issue... 
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Oscillations From Blinking Lights 



Blinking lights cause oscillations in the histogram that 


cause unwanted oscillations in the final tonemap scalar! 
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The "Sticky Bin" 

• Make bin containing 95% target "sticky" 



it n 


This causes minor variations in light to have no effect 
until passing threshold 
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“Sticky Bin" Fixes Oscillations 
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Final Tonemapping Heuristics 

1. Bright pixel threshold 


2. Median luminance (darkness barrier) 


3 . Sticky bin 
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(A section from the non-real-time Portal trailer 2006) 
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Motion Blur Goals 

• I solated, self-sufficient system 

• Shader models 2.0, 2.0b, 3.0 

• No additional memory (system or video) 

• Performance! 

• I don't want to spend more than one week 
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Evaluating Types of Motion Blur 

1 . Camera rotations - Can be done in post 

2 . Camera translations - Needs depth or 
vector image for correct parallax 

3. Object translations - Needs vector image or 
"fins" 


4. Object rotations & animation - Needs 
vector image or "fins" 
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Motion Blur: Where in the Pipeline? 

We don't want to blur the weapon! 



1 . Render full scene 

2. Motion blur 





3. Render view model / weapon 

4. Render GUI 
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^ Rendering Motion Blur 
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Camera Rotation: Pitch 

• Blur vector is just vertical 
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Camera Rotation: Yaw 

• Not as simple as pitch 


• Need two separate solutions 


• We roll when we turn left/right while looking 
down! 
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Camera Rotation: Yaw (Part A) 



• Blur vector is horizontal 



CMP 


• This fades in/ out with pitch 



VALVE 


WWW.GDCONF.COM 



Camera Rotation: Yaw (Part B) 

• Roll motion blur 

• This fades in/out with pitch 





This approximation is very efficient to implement! 
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Portal Falling Blur 



When falling and looking down generate 
forward motion vectors 







Generating the Final Blur Vector 

• Blur vectors computed per- pixel: 

• Pitch: Full screen vertical vector 

• Yaw: Full screen horizontal vector 

• Yaw: Roll vector 

• Falling: I nside/out vector 


Combine these individually weighted vectors 
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Sample along the vector and average 
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Special Case: Portal Transitions 

• Moving through portals caused a jolt 




• Use last frame's blur values when moving a 
far distance in a single frame 


VALVE 




WWW.GDCONF.COM 



Special Case: System Hitches 



feamepevelopers: 


Another process stole CPU cycles from the 
game and caused a hitch 

• 'You've got mail!" 

• 'Time to update your software!" 


• System hitches can cause one very blurry 
frame 
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• Time lapse between frames greater than 0.1 
seconds, we disable motion blur for that 
frame 
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Special Case: Headache 



• Variable frame rate and blur made people sick 

• Only an issue when frame rate is low with variable frame 
rate (Does not apply to the 360 since we're vsync'd!) 

• Motion blur vector is globally scaled down as frame rate 
drops from 50-30 fps 

• Use minimal motion blur to achieve the effect. We only use 
15% of full-frame shutter! 

• Limit blur to 4% of screen width 
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Motion Blur Summary 

• I solated system 

• Blur from camera rotation only 

• Special case Portal falling blur 

• Acceptable performance & no additional 
memory 

• 90% of Orange Box customers 
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Summary 

• sRGB - DX9, DXIO, XBox 360 

• Tone Mapping 

• Motion Blur 

• Additional details about our rendering: 

http: //WWW. valvesoftware.com/Dublications. html 
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Thanks! 


Alex Vlachos, Valve 

alex@valvesoftware.com 
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